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1. Introduction 

Evolution of the probabilities of configurations in a class of one-dimensional 
stochastic models is described by the master equation like this: 

jP L {t) = -HP L (t), (1) 

where H is a transition rate matrix and PL(t) is a column vector whose 
component P(C; t) is the probability of finding the L-site system in a con- 
figuration C at time t. If Ph{t) is independent of t, we obtain from Eq. (1) 

= HP L . (2) 

We call the solution Pl of this equation the stationary state. Usually, as 
t — > oo, Pi,(t) reaches a stationary state Pl. So, once we have the stationary 
state, we can calculate, for example, the density profile, correlations, etc. 
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in the long-time limit. From this viewpoint, obtaining stationary states is 
important in nonequilibrium statistical mechanics. 

For small L, one can solve Eq. (2) numerically and study its properties 
exactly. But, in general, obtaining stationary state for any system size L 
as a function of L is a difficult task. 

It is known that, for some one-dimensional stochastic models, their sta- 
tionary states can be written in a special form, namely, in the form of matrix 
products. We call this the matrix product stationary statc(MPSS). 2 We 
consider the situation in which this matrix is independent of system size; 
in this case, we can construct its stationary state for any system size. 

Thus we want to find matrices which compose a MPSS. Although, the 
dimensions of those matrices are generally infinite for a model whose in- 
teraction range is finite, 3 ' the dimensions can be finite for some models 
including the ASEP under some conditions for model parameters. 5 ' 6 We 
call a MPSS for the former(resp. latter) case an infinite(resp. a finite)- 
dimensional MPSS. To our knowledge, there is no systematic way of 
constructing an infinite-dimensional MPSS. But, for a finite-dimensional 
MPSS, we found a systematic way of finding them, 1 which we explain in 
this article. 

Our construction explained in this article was first presented in a part 
of Ref. 1, where the above-mentioned construction and a systematic way of 
checking the validity of the obtained MPSS for an arbitrary system size were 
explained for general stochastic models on the one-dimensional lattice. Main 
purpose of this article is to give more details on the treatment in Ref. 1. In 
order to explain our construction concretely, we use in this article only the 
one-dimensional asymmetric simple exclusion process(ASEP). 7 

It is interesting that numerical matrix product states in stochastic mod- 
els (for example, Ref.8) also play an important role in the method of density 
matrix renormalization group (DMRG). 9-11 This article, however, does not 
treat such a numerical method. 

2. Model 

The ASEP in this article a is defined on the one-dimensional lattice whose 
size is L(Fig. 1). Each site can take two states, namely, a site is either empty 
or occupied by one particle. The time of the model is continuous. A particle 
in the bulk hops to the left(resp. right) neighbor site with a rate g(resp. 1) 
if the left(resp. right) neighbor site is empty. At the leftmost site, a particle 



a The ASEP in this article is also called Partially ASEP(PASEP). 
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is injected with a rate a if the site is empty. A particle at the rightmost 
site is removed with a rate j3 if the site is occupied by a particle. 




Fig. 1. The ASEP on the one-dimensional lattice whose size is L = 5. A particle in 
the bulk hops to the left(resp. right) neighbor site with a rate q(resp. 1) if the left(resp. 
right) neighbor site is empty. At the leftmost site, a particle is injected with a rate a if 
the site is empty. A particle at the rightmost site is removed with a rate if the site is 
occupied by a particle. 



As for the master equation, for example, PL=i{t) in Eq. (1) has the 
following components: 
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(3) 



where Tk (1 < k < 4) in the component P (ri, T2, T3, T4; t) of Eq. (3) repre- 
sents the number of a particle at the k-th site. The transition rate matrix 
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in Eq. (1) for the ASEP is denned as follows: 



L-l 



H-hM + ^hk + hW. 



(4) 



k=i 



In this equation, M L )(resp. ft/ R ') which expresses injections of particles at 
the leftmost site(resp. removals of particles at the rightmost site), is defined 

by 

^L) :=/l left 0/ ®(L-l) and h (R) ._ j®(L-l) % fright _ (5) 



where 



.left ._ / a 
' ' ' a 



(6) 



fright . = 



0^/3 

f3 



(7) 



Eq. (6)(resp. Eq. (7) ) is expressed in a basis of states whose order is 
Ti = 0, l(resp. tl = 0, 1). In Eq. (5), we introduce a shorthand notation of 
direct products of the two-dimensional identity matrix /: 



7®7( 



(8) 



In Eq. (4), hk, which describes hopping process between fc-th and (fc + l)-th 
sites is defined 



where 



h k :-/®( fe - 1 )®/ lint ®/®( i - fe - 1 ) 



fO 0\ 
q -1 
-q 1 

\o o o o/ 



(9) 



(10) 



This is expressed in a basis of states whose order is (Tfc,Tfc + i) = 
(0,0), (0,1), (1,0), (1,1). 



3. Matrix product stationary states (MPSSs) 

It is possible that some models including the ASEP have a special form of 
a stationary state, namely, a matrix-product stationary state(MPSS). For 
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example, "the vector Eq. (3) can be represented by a MPSS" means that 
there exist (W | , E , D and | V) such that Eq. (3) is equal to 




Generally, the MPSS for the ASEP is the stationary state which is equal 
to the following form 




In Eq. (11) and Eq. (12), 

• {W\ and \V) are an M-dimensional row vector and an M- 
dimcnsional column vector, respectively. 

• E and D are M-dimensional square matrices. 

• Zl is the normalization constant whose definition is 

Z L := (W\(E + D) L \V). (13) 

Hereafter, we call Eq. (12) an M-dimensional MPSS. It should be noted 
that M is not always finite(in general, M is oo) as explained in Sec. 1. 

In the following section 4, we derive necessary conditions for the exis- 
tence of an M(= 1, 2)-dimensional MPSS for the ASEP by using its sta- 
tionary states for finite system sizes. In the subsequent section(Sec. 5), we 
explain how to find (W\, E, D and \V) in a two-dimensional MPSS assum- 
ing the existence of the MPSS. 

4. Necessary conditions for the existence of an 
M(= l,2)-dimensional MPSS 

In this section, we derive necessary conditions for the existence of an M(= 
l,2)-dimensional MPSS for the ASEP b . 

As a tool of our derivation, we introduce a matrix form of a stationary 
state Pl ■ This form has the same components as Pl ■ The difference between 
the matrix form and Pl exists in ways of arranging the components. For 
example, the matrix form P 2 ' 2 is defined by rearranging components of 



b Ref. 1 describes also derivation for general M-dimensional MPSSs which some models 
with TV states per site have. The ASEP in this article corresponds to N = 2. 
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Pz,=4.(see the components of Eq. (3) with t ignored) as 

/P(0, 0, 0, 0) P(0, 0, 0, 1) P(0, 0, 1, 0) P(0, 0, 1, 1)\ 
2 , 2 = P(0, 1, 0, 0) P(0, 1, 0, 1) P(0, 1, 1, 0) P(0, 1, 1, 1) 
' • P(1,0,0,0)P(1,0,0,1)P(1,0,1,0)P(1, 0,1,1) 
\P(1, 1, 0, 0) P(l, 1, 0, 1) P(l, 1, 1, 0) P(l, 1, 1, 1)J 



(14) 



According to this definition, the matrix form P 2 ' 2 converted from the 
MPSS(Eq. (12) with L = 4) is 



p2,2 
1 



/(W\EEEE\V) (W\EEED\V) (W\EEDE\V) (W\EEDD\V)\ 
{W\EDEE\V) (W\EDED\V) (W\EDDE\V) (W\EDDD\V) 
\w\DEEE\V) \w\DEED\V) \w\DEDE\V) (W\DEDD\V) 
\(W\DDEE\V) {W\DDED\V) (W\DDDE\V) (W\DDDD\V)J 



(15) 

Generally, the matrix form p m >™ converted from the MPSS(Eq. (12)) can 
be written down as 

„™ „ 1 / Hi 



J m+n 



(W\[\ (E D) \V), (16) 



with m + n = L. 

The rank of a matrix form is important to our derivation. Suppose, by 
elementary transformations, the 2 m x 2™ matrix p m > n can be transformed 
into a matrix whose form is 



I r \B 
O 



(17) 



where I r , O and B represents the r x r identity matrix, an (2 m — r) x 2™ 
zero matrix and an r x (2™ — r) matrix, respectively. Then, we can tell that 
the rank of p m >™ is r because elementary transformations do not change 
ranks of matrices and the rank of Eq. (17) is r. Therefore, the rank of P 2 ' 2 
in Eq. (14) is generally greater than 2. However, we can prove the fact that 

"if the stationary state can be written in a two(resp. one)-dimensional 
MPSS, the rank of P 2 ' 2 is at most 2(rcsp. 1)." (18) 

We give a proof of this fact only for the case of a two-dimensional MPSS. c 



c This proof is slightly different from one in Ref. 1. 
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From Eq. (16) with m = n = 2, wc obtain 

Z 4 P^:=(W\[2j (EDf 2 \V). (19) 

The right hand side of this equation can be written as a matrix product 

AB (20) 

where 

A:=(W\(^y 2 , B:={ED) m \V). (21) 

A is a 4 x 2 matrix and B is a 2 x 4 matrix. Please note that both of the 
rank of A and the rank of B is at most 2. And linear algebra tells us that 
the rank of AB is less than or equal to the smaller number of the rank of 
A and the rank of B. This concludes the rank of P 2,2 is not greater than 2. 

Using the fact (18), let us calculate concretely the necessary condition 
of existence of an M(= 1, 2)-dimensional MPSS for 

a > , /3 > . (22) 

First, we obtain Pl=4 by solving Eq. (2) with L — 4. And then we convert 
the vector form Pl=a into the matrix form P 2 ' 2 . In the following, we denote 
the element in the i-th row and the j-th column of a matrix A by (A) i j. 
According to Maple, which is one of computer algebra systems, we get 

( Z4P2,2 )m=(£) 4 < < 23 ) 

Because this is nonzero element(see Eq. (22)), we can multiply the first row 
of P 2 ' 2 by the inverse of Eq. (23). Then, we subtract the first row of the 
resultant matrix multiplied by (P 2,2 ) 1 (i = 2, 3, 4) from the z-th row. Thus 
we obtain a matrix A^ like this: 

/l * * *\ 
* * * 
* * * 
\0 * * */ 

where the elements denoted by "*" mean some expressions. The second 
diagonal element of A^ is this: 

( A (2)\ = _ P 2 (a + q)(a-l + P + q) (2g) 
V /2,2 a 2 

(x(a-l + P + q). (26) 



(24) 
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case 1 First, we treat the case 

a-l + fi + q^O. 



(27) 



Multiplying the second row of by the inverse of (A^) 22 in Eq. (25), 

we obtain the matrix . Then, we subtract the second row (of A^ ) 
multiplied by (A^). 2 (i = 1, 3,4) from the i-th row of A (2 \ Thus we obtain 
the matrix, which we call A^\ like this: 



fl * *\ 
1 * * 


Vo o * */ 



(28) 



It should be noted that any of the elements of the third row of this matrix 
is zero, o is 



_ (q + 1) (a/3 + aq - q + q 2 + q0) (a - 1 + f3 + q) (3 
4,3 a + q 

cx (a/3 + - q + q 2 + q/3) (a - 1 + /3 + q) 



This is nonzero if we assume Eq. (27) and 

a/3 + aq - q + q 2 + q/3 ^ 0. 



(29) 
(30) 

(31) 



We interchange the 3rd row and the 4th row of A^ and call the resultant 
matrix A'^ . 

Because (A'^) 3 3 = (^1 (3) ) 4 3 ^ 0, we can multiply the 3rd row of A'^ 

.(3) 

by the inverse of (A'( 3 )) 3 . We call the obtained matrix A' . Then, we 

~(3) 

subtract the 3rd row (of A' ) multiplied by (A' (3) ). 3 from the i(= 1, 2, 4)- 
th row. Thus we obtain the matrix 



A^ := 



10 

1 

001 p- 1 





(32) 



Comparing this with Eq. (17), we know the rank of A^ is 3. 
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case 2 We go back to Eq. (30) and treat the case where Eq. (31) does not 
hold. In this case, 



a/3 + aq - q + q 2 + q(3 = 

We solve this with respect to a and obtain 

q(-l + P + q) 



0. 



a ■■ 



13 + q 



(33) 
(34) 



Substituting this into A^ 3 \ we obtain 



1 


9(- 

/ 


HP+q) 


q(-l+P+q) 2 
P 2 (P+q) 


1 


9/3- 


0-2 q+q 2 


2 9 2 +3< ?/ 3-2< ? -/3+/3 2 




P+q 


0(P+q) 

























(35) 



Comparing this with Eq. (17), we know the rank of Eq. (35) is 2. 

case 3 We go back to Eq. (26) and treat the case where Eq. (27) does not 
hold. In this case, 



(36) 
(37) 



l+P+q (-l+fi+q) 2 



a - 1 + /3 + q = 0. 
We solve this with respect to a and obtain 

a = 1 — /3 — q 
Substituting this into A^ 2 \ we obtain 

1 P 







Comparing this with Eq. (17), we know the rank of Eq. (38) is 1. 
In summary, 

• the rank of P 2 < 2 is 3 ifa-l+fi+q ^ and a/3 + aq-q + q 2 + q/3 ^ 
are satisfied. d 



(38) 



d The reason why the rank is not 4 in this case is that the ASEP has infinite-dimensional 
MPSSs with 

(DE - qED) oc(E + D) , D \ V) <x| V) (39) 
and thus EE \ V),ED | V),DE \ V) and DD \ V) can be written as linear combinations 
of (at most) three independent vectors. 
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• the rank of P 2 ' 2 



is 2 if a - 1 + /3 + q ^ and 
af3 + aq - q + q 2 + qfi = 



(40) 



are satisfied. 
• the rank of P 22 is 1 if 



a-1 + /3 + q = 



(41) 



is satisfied. 



So we can conclude that according to the fact(18), Eq. (40)(resp. 
Eq. (41)) is the necessary condition of existence of a two(resp. onc)- 
dimensional MPSS. These conditions agree with the known result. 5 ' 6 ' 12,13 

5. How to find two-dimensional matrices and vectors in 
MPSSs for the ASEP 

For the ASEP, the MPSS is constructed according to Eq. (12) with 
matrices(j5 and D) and vectors((l4 7 | and \V)). Hereafter we call the matri- 
ces and vectors in the MPSS "the set of matrices" . 

In this section, we explain our way of finding the set of matrices in 
the two-dimensional MPSS for the ASEP when Pl can be expressed as a 
MPSS. It should be noted that our way of finding is not restricted to two- 
dimensional MPSS for the ASEP. Our way can be applied to finite M(> 2)- 
dimensional MPSSs for models which have the finite numbers N(< M) of 
states per site. 1 

A similarity transformation plays a crucial role in our way of finding. 
So we begin with an explanation of the transformation in the MPSS. 
Let us consider a similarity transformation for the set of matrices 



E := S-^ES , D-^S^DS, (W\ := (W\S , \V) := S'^V), (42) 



where S is a 2 x 2 matrix. Please note that, in this section, E and D are 2x2 
matrices and (W\ and \ V) are two-dimensional vectors. The transformation 
Eq. (42) does not change a matrix form Eq. (16) including, for example, 



p2,2 



2 in Eq. (15). 
We make a choice S in Eq. (42) as c 




(44) 



e The following set of Eqs. (44) and (45) is what the equation 

S:=(E\V) D\V)), 
which is Eq. (2.28) in Ref. 1, means. 



(43) 
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where 



11 



■= E \ v ) r\:=D\V). (45) 



Our choice, namely, the set of Eqs. (44) and (45), plays another crucial role 

'1 N 



in our way of finding. Because of S 1 S 



1 



Using Eqs. (42) and (45) and (46), we can derive f 

E\V) = S~'E\V) = S- 1 Q = Q . (48) 

.:E\V)=Q. (49) 
Similarly, we can derive also the equation 

D\V) = (^j . (50) 

Using Eqs. (49) and (50), we can derive the equations for E and D g 
Z 3 P 1 ' 2 ^ : 2,1 : 2] = (Z 2 P 1 ^)E (52) 

and 

Z 3 P 1>2 [1 :2,3:4] = (Z 2 P 11 )D. (53) 

In Eqs. (52) and (53), we introduce the notation A[b : c,d : e] for a subma- 
trix of a matrix A, which is constructed by selecting the row range from 
the &-th row to the c-th row and the column range from the cZ-th column 
and e-th column. 



f The following set of Eqs. (49) and (50) is what the equation 

(J °) = (E\V) D\V)) , (47) 
which is Eq. (2.29) in Ref. 1, means. 

s The following set of Eqs. (52) and (53) is what the equation 

ZzP 1 ' 2 = Z2P 1 ' 1 (e 5) , (51) 
which is Eq. (2.35) in Ref. 1, means. 
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The derivation of Eqs. (52) and (53) is postponed in the end of this 
section. h 

Obtaining E and D from Eqs. (52) and (53) under Eq. (40) ' is, of 
course, easy: By solving Eq. (2) for L — 2 under Eq. (40), we obtain Pl=2- 
Then we convert the matrix form Zi P > from Z^ Pl=2 as we converted 
Eq. (14) from Pl=a- Similarly, we obtain the matrix form Z% P 1 ' 2 . By 
multiplying the inverse of the 2x2 matrix Z2P 11 from the left of both 
sides of Eq. (52)(resp. Eq. (53)), we can obtain the solution E(iesp. D). 

Now that we know E and D, we can obtain |F)(resp. (W\) from Eq. (49) 
or Eq. (50)(resp. the set of Eqs. (59) and (56) or the set of Eqs. (59) and 
(60). We can show 1 that the thus obtained E, D, \V) and (W\ are equivalent 
to the known results. 5 ' 6 ' 12,13 

In the remaining part of this section, we derive only Eq. (52) ( we can 
derive Eq. (53) in the similar way). 

By the definition Eq. (16) and the similarity transformation Eq. (42), 
we have 

Z 2 P^ = {W\(^(ED)\V). (54) 



Therefore 

' {W\E 2 \V) (W\ED\V) 

Using 



7 P 1 ' 1 = v ~ >~J J V ZJ „>1 1 ('55 s ) 
\{W\DE\V) (W\D 2 \V) J 1 1 



(W\E =: ( Xl , yi ) , (56) 
(V^|i? 2 |y) in Eq. (55) is equal to x\ in Eq. (56) because 

(W\E 2 \V) = (W\E (I) = Xl , (57) 



where the first (resp. second) equal sign in Eq. (57) holds because of Eq. (49) 



h The derivation starts at the paragraph containing Eq. (54). 

'In this article, we assume that the necessary condition Eq. (40) for existence of a two- 
dimensional MPSS is also sufficient condition. 
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(resp. Eq. (56)). In the similar manner, using also Eq. (50), we can show j 

ZiPV = h Vl ) , (59) 

where we introduced 

(W\D =: (x 2 ,y 2 ). (60) 
By the same way as the derivation of Eq. (54) , we have 

Z 3 P^ = (W\(^fj (EDf 2 \V). (61) 

From this equation, we obtain the left part of Z^P 1 ' 2 

7 PMFI • 2 1 • 21 - ( ^\&\V) {W\E 2 D\V} \ 

Using Eq. (49), the left upper element in the right hand side of this equation 
can be transformed as 

(W\E 3 \V) = ((W\E 2 ) Q . (63) 

Using Eq. (50), the right upper element in the right hand side of Eq. (62) 
can be transformed as 

(W\E 2 D\V) = ((W\E 2 ) (J) . (64) 

Eqs. (63) and (64) mean that components of the first row of 
Z z P 12 [l : 2,1 : 2] is equal to components of (W\E 2 (= (x 1} yi) E^j . Simi- 
larly, we can show that components of the second row of Z 3 P 1,2 [1 : 2, 1 : 2] 
is equal to components of (x 2 , 2/2) E. Therefore we obtain 

Z 3 P 1 ' 2 [1:2,1:2]= f^'^JfV (65) 
\{x 2 ,y 2 )E 



J The set of Eqs. (59), (56) and(60) is what the equation 

'(W\E 
(W\D 



which is Eq. (2.30) in Rcf. 1, means. 
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that is, 



Z 3 P 12 [1 : 2,1 : 2] 



(: 



X2 2/2 



xi yi 



) 



E. 



(66) 



This equation and Eq. (59) means Eq. (52). In the similar way, we can show 



6. Summary 

In this article, after a brief introduction, wc described the asymmetric sim- 
ple exclusion process (ASEP) in Sec. 2 and a matrix product stationary 
state(MPSS) for the ASEP in Sec. 3. 
Furthermore, we have explained: 

(i) a systematic way to find necessary conditions for the existence of 
an M(= l,2)-dimensional MPSS(Eq. (12)) in Sec. 4; 

(ii) a systematic way by which the two-dimensional matrices(£? and 
D) and vectors((VF| and \V)) in the MPSS(Eq. (12)) can be con- 
structed from the stationary states for the two-site system and the 
three-site system if the condition in (i) is also a sufficient condition. 

The method (i)(resp. (ii)) is applicable to M(> 2)-dimcnsional 
MPSSs(Eq. (12)) for not only the ASEP but also models which have 
N(> 2)(resp. N(< M)) states per site. 1 

For other examples and details, please see Ref. 1. This reference ex- 
plains also a systematic way to check the validity of the obtained MPSS for 
arbitrary system sizes in the restricted models. 
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